📏 ANN Benchmarks - emschwartz · Scour

Lower Latency and Higher Throughput with Multi-node DeepSeek Deployment

research.perplexity.ai·10h

🏗️LLM Infrastructure

CACTUSDB: Unlock Co-Optimization Opportunities for SQL and AI/ML Inferences

arxiv.org·1d

Google AI Introduces STATIC: A Sparse Matrix Framework Delivering 948x Faster Constrained Decoding for LLM Based Generative Retrieval

marktechpost.com·1d

🔤Tokenization

Optimizing Recommendation Systems with JDK’s Vector API

netflixtechblog.com·6h·

Discuss: Hacker News, r/programming

🔄SIMD Programming

Efficient frequent directions algorithms for approximate decomposition of matrices and higher-order tensors

jmlr.org·19h

📉Embeddings Optimization

Ditching MongoDB Text Indexes for Edge N-Grams

hjr265.me·1d

🌲GIN Indexes

and we have new evidence

quarkus.io·6h

⚡Systems Performance

SemiAnalysisAI/InferenceX: Open Source Continuous Inference Benchmarking Qwen3.5, DeepSeek, GPTOSS - GB200 NVL72 vs MI355X vs B200 vs GB300 NVL72 vs H100 & soon™ TPUv6e/v7/Trainium2/3

github.com·1d

🏗️LLM Infrastructure

The AI Efficiency Survey

sambanova.ai·1d

🏆LLM Benchmarking

Architecting and Evaluating an AI-First Search API

research.perplexity.ai·10h

🕷️Web Crawling

Optimal Heterogeneous Memory Configs for AI Tasks Under Specified Performance Metrics (Stanford, UCSC)

semiengineering.com·1d

🧠Memory Hierarchy Design

The Architecture Behind Open-Source LLMs

blog.bytebytego.com·15h

🏗️LLM Infrastructure

GPU-Native Approximate Nearest Neighbor Search with IVF-RaBitQ: Fast Index Build and Search

arxiv.org·1d

📇Vector Indexing

Qwen 3.5 9B, 4B models beating 30B, 80B models

huggingface.co·12h·

Discuss: Hacker News

🏆LLM Benchmarking

🐥 Optimizing nested array operations in PHP: from O(3n) to O(n)

yellowduck.be·1d

🏹Apache Arrow

Finite Neural Networks as Mixtures of Gaussian Processes: From Provable Error Bounds to Prior Selection

jmlr.org·19h

🧠LLM Inference

I built a persistent memory layer for AI agents in Rust

news.ycombinator.com·12h·

Discuss: Hacker News

Rare Huawei-ByteDance alliance unveils RRAM AI chip delivering 66x CPU speed at ISSCC 2026

digitimes.com·15h

🖥️Hardware Architecture

Monday AI Radar #15

lesswrong.com·2h

Inception Labs says its diffusion LLM is 10x faster than Claude, ChatGPT, Gemini

thenewstack.io·10h

🏗️LLM Infrastructure

Loading more...